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AsteroFLAG: first results from hare-and-hounds Exercise #1 
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We report on initial results from the first phase of Exercise #1 of the asteroFLAG hare and hounds. The asteroFLAG group 
is helping to prepare for the asteroseismology component of NASA's Kepler mission, and the first phase of Exercise #1 
is concerned with testing extraction of estimates of the large and small frequency spacings of the low-degree p modes 
from Kepler-like artificial data. These seismic frequency spacings will provide key input for complementing the exoplanet 
search data. 
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1 Introduction 

With the recent launch of CoRoT (Baglin et al. 2006), the 
upcoming launch of Kepler (Basri et al. 2005), and contin- 
uation of observations by ground-based teams (Bedding & 
Kjeldsen 2006, 2007) and MOST (Matthews et al. 2007), 
we stand on the threshold of a critical expansion of aster- 
oseismology of Sun-like stars, the study of stellar interiors 
by observation of their global acoustic modes of oscillation. 
Sun-like oscillations give a very rich spectrum allowing the 
internal structures and dynamics to be probed down into the 
stellar cores to very high precision. Asteroseismic observa- 
tions of many stars will allow multiple-point tests of crucial 
aspects of stellar evolution and dynamo theory. 

The aims of the asteroFLAG collaboration are to help 
the community to refine existing methods for analysis of 
the asteroseismic data on Sun-like stars and to develop new 
ones. The asteroFLAG group is diverse. There is expertise 
from those involved in the cutting-edge ground-based aster- 
oseismic observations; members of the CoRoT Data Anal- 
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ysis Team (DAT) (see Appourchaux 2003; 2006a, b); mem- 
bers of the Kepler Asteroseismology Science Consortium 
(KASC) (Christensen-Dalsgaard et al. 2007); leading theo- 
reticians on the interior structures of stars and Sun-like os- 
cillations; and those involved in the analysis of the so-called 
"Sun-as-a-star" helioseismology data, for which the analy- 
sis methods have direct application to the asteroseismic case 
(e.g., Chaplin et al. 2006). 

The input data for probing stellar interiors are the mode 
parameters, such as individual frequencies, frequency split- 
tings, linewidths and powers. For those stars where mea- 
surement of individual mode parameters is difficult, the in- 
put data will be the likes of average frequency spacings. 
Accurate mode parameter data are a vital prerequisite for 
robust, accurate inference on the internal structures of the 
stars. Our objectives are to test aspects of the complete anal- 
ysis pipelines for stars, i.e., extraction of estimates of the 
mode parameters from observations, through to procedures 
used to draw inference on the fundamental stellar properties 
and the internal structures. 

Initially, asteroFLAG is concentrating on main-sequence 
stars and is conducting the work within a hare-and-hounds 
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framework. Sets of artificial asteroseismic data will be made 
by hares in the group, to simulate observations by different 
instruments (both ground and space-based). Information for 
constructing the artificial data comes from several sources, 
including full stellar evolutionary codes and analytical de- 
scriptions of the stochastic excitation and damping of the 
Sun-like oscillations. The artificial data are then being ana- 
lyzed by other members of the group, who are the hounds. 

AsteroFLAG is already involved in helping to prepare 
for the asteroseismology component of NASA's Kepler mis- 
sion. In this paper, we report on the initial results of the first 
phase of Exercise #1 of the asteroFLAG hare and hounds, 
which is concerned with extraction of the large and small 
frequency spacings of the p-mode spectra, from Kepler-like 
observations of main-sequence stars. 

2 Exercise #1 of asteroFLAG hare and 
hounds: Observations by Kepler 

In addition to searching for Earth-like exoplanets (via the 
transit method), NASA's Kepler mission will also provide 
an unprecedented opportunity to study a wide range of stars 
by asteroseismology. The Kepler Asteroseismology Inves- 
tigation (KAI) will be arranged around the Kepler Astero- 
seismic Science Operations Centre (KASOC), which will 
be based at the Danish AsteroSeismology Centre (DASC, 
Aarhus) (Christensen-Dalsgaard et al. 2007). There is wide 
participation from the international community in the Ke- 
pler Asteroseismology Science Consortium (KASC). 

The nominal mission lifetime is w 4 years. There will 
potentially be a few hundred Sun-like asteroseismic targets, 
with about 100 eventually getting continuous coverage over 
the entire mission. This last element is crucial, in that it is 
only from extended observations that certain scientifically 
rich, but extremely subtle, elements of the oscillation spec- 
tra can be measured, e.g., frequency asymmetries of mode 
peaks (diagnostics of granulation) and frequency asymme- 
tries of mode splittings (diagnostics of magnetic dynamo 
signatures). 

The first phase of Exercise #1 is concerned with test- 
ing extraction of estimates of the large and small frequency 
spacings of the low-degree modes. These seismic frequency 
spacings will provide key results for complementing the ex- 
oplanet search data (e.g., see Stello et al. 2007a): the large 
spacings provide tight constraints for estimating radii of the 
exoplanet host stars, which may then be used to give precise 
estimates of the exoplanet radii; while the small spacings 
may be used to help constrain ages of the host stars. The 
ultimate goal of Exercise #1 will be to estimate the radii of 
the artificial stars, using the estimated spacings as one of the 
key data inputs. 

When mode peaks observed in the power frequency spec- 
tra are of sufficient quality it will be possible to obtain ex- 
tremely precise estimates of individual mode frequencies, 
for example by application of peak-bagging fitting methods 
developed for Sun-as-a-star data. Use of individual mode 



frequencies will then allow even tighter constraints to be 
placed on the stellar radii, and we will also test such analy- 
ses using the artificial asteroFLAG datasets. 

Our intention is to provide input and guidance to the 
KASC to help develop a robust strategy, or recipe, for esti- 
mation of stellar radii under different dataset scenarios (i.e., 
for different intrinsic stellar properties and noise levels). In 
this paper we show initial results from Exercise #1 on esti- 
mation of the large spacings. WJC and four other colleagues 
(T. Appourchaux, GH, RN and TS) have thus far acted as 
the hares, and have generated artificial data on a selection 
of main-sequence stars for other members of the group, the 
hounds, to analyse blind. The hounds who have returned re- 
sults thus far are T. Arentoft, JB, OC, STF, RAG, SJJ-R, CR 
and DS. 

2.1 The asteroFLAG simulator 

A detailed description of the asteroFLAG simulator will be 
presented elsewhere (Chaplin et al., in preparation). Here, 
we note briefly the main elements of the simulator. These 
elements are shown visually in block diagram form in Fig- 
ure 1, with the simulator configured for observations made 
in intensity. Each timeseries comprises photometric pertur- 
bations from: p modes; granulation noise; active region noise; 
and photon shot and instrumental noise. 

2.1.1 Fixing the input parameters 

We have used the Aarhus stellar evolution code (ASTEC) 
and the adiabatic pulsation code ADIPLS to compute theo- 
retical adiabatic pulsation frequencies of the artificial stars 
(Christensen-Dalsgaard 2007a, b). We use results on stel- 
lar equilibrium and pulsation calculations, which have been 
applied in detail to the Sun and other Sun-like stars (Balm- 
forth 1992; Houdek et al. 1999; Houdek & Gough 2002), 
to estimate the excitation rates and damping rates of the p 
modes. The amplitudes of the stochastically excited modes 
were obtained in the manner of Chaplin et al. (2005, 2007a). 

Latitudinally dependent surface rates of rotation were 
fixed according to empirical laws, with scaling fixed by the 
colour, B—V, and age of the star (Aigrain, Favata & Gilmore 
2005; Cardini & Cassatella 2007; Donahue et al. 1996; Rein- 
ers & Schmidt 2003). (The B — V colour was derived from 
the effective temperature, T e g, and metallicity of the model, 
using the empirical relations of Alonso, Arribas & Martinez- 
Roger 1996.) Rotation kernels calculated from the stellar 
models, together with simple internal rotation laws, were 
then used to determine the rotational frequency splittings. 
We note that the rotational frequency splittings of the mod- 
els used in Exercise #1 were fixed deliberately at Sun-like, 
twice Sun-like and three-times Sun-like values (see Sec- 
tion 2.2 below). 

Stellar-cycle effects were not included in the artificial 
timeseries data described in this paper. However, the aster- 
oFLAG simulator can include these effects. The outline im- 
plementation is as follows. A commonly used indicator of 
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Fig. 1 The main elements of the asteroFLAG simulator. 



surface activity on stars is the Ca II H & K index. This in- 
dex is usually expressed as i?HK : tr, e average fraction of the 
star's total luminosity that is emitted in the H & K line cores 
(having been corrected for the photospheric component). 
We use scaling relations due to Noyes (1983) and Noyes et 
al. (1984), which require B — V and the surface rate of ro- 
tation, to estimate i?^ K for our artificial stars. Scaling laws, 
based on fits to observations (Radick et al. 1995; Saar & 
Brandenburg 2002) of stellar-cycle variability in i?^ K were 
then used to fix the amplitudes, AR' HK , and the periods of 
the stellar cycles. Cycle amplitudes AR' HK were then con- 



verted to equivalent p-mode parameter shifts (e.g., in fre- 
quency, power and damping) in the manner described in 
Chaplin et al. (2007a). There is also the provision to include 
effects of acoustic asphericity, from the non-homogeneous 
distribution of the simulated near-surface activity (again, 
see Chaplin et al. 2007a). 

Mode visibilities were calculated according to Christensen- 
Dalsgaard & Gough (1982). We also allowed for limb dark- 
ening, and used the limb-darkening laws of van Hamme 
(1993) to describe variation of the limb-darkening proper- 
ties from one star to another. These laws use the effective 
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temperature, T e g, and the surface gravity to fix the coeffi- 
cients describing the limb-darkening. 

To estimate the standard deviation and timescale of the 
granulation, we have used scaling laws, and scaled against 
solar values (see also Stello et al. 2007b; Kjeldsen & Bed- 
ding, in preparation). The solar values were estimated from 
analysis of a multi-year timeseries of solar intensity obser- 
vations made by the VIRGO/PM06 instrument on board 
the ESA/NASA SOHO spacecraft. We have assumed that the 
standard deviation of the brightness fluctuations scales in 
inverse proportion to the square root of the number of con- 
vective cells on the surface of the star (we assume the cells 
are statistically independent; see also Ludwig 2006). The 
characteristic size of cells was assumed to scale with the 
product of the mixing length parameter and the isothermal 
scale height at the surface of the star. The brightness fluc- 
tuations associated with individual cells were assumed to 
scale with the surface velocities associated with the convec- 
tion, which came from the stochastic excitation models that 
were used to predict the mode excitation and damping rates. 
To estimate the timescale of the granulation we assumed it 
scales in inverse proportion to the acoustic cut-off frequency 
of the star. 

The standard deviation of the active region noise was 
assumed to scale with i?HK' m me manner described by 
Aigrain, Favata & Gilmore (2005). We also allowed for the 
effect of the angle of inclination of the star, having assumed 
the active-region signal was confined within certain bands 
of stellar latitude, using the work of Knaack et al. (2001) 
as a guide. We assumed the timescale of the active-region 
signal scaled with the period of rotation of the star. 

For the photon shot noise, we used the latest estimates 
of the expected precision of the Kepler observations at dif- 
ferent m v . These data were provided to HK by the Kepler 
team. 

2.1.2 Generation of the artificial data 

Components due to granulation and active regions were gen- 
erated in the time domain using a stochastic, autoregressive 
model of the AR[1] type (e.g., see Koen 2005). 

We used code based on the latest version of the solarFLAG 
(Chaplin et al. 2006) timeseries generation code to make the 
p-mode timeseries (the solarFLAG generator is described 
in Chaplin et al., in preparation). Each (n, l 7 m) component 
was generated in the time domain. Components were mod- 
eled as forced, damped harmonic oscillators, re-excited at 
frequent intervals (here, every minute). The oscillators were 
re-excited by a timeseries of 'kicks' made from the gran- 
ulation noise. Kicks given to overtones of the same (l,m) 
were correlated. Implicit in this approach is the assumption 
that on the Sun, the excitation function of a mode of a given 
(I, m) is the same as the component of the granulation that 
has the same spherical harmonic projection over the corre- 
sponding range in frequency (Toutain, Elsworth & Chaplin 
2005). Correlations of the excitation of different overtones, 



coupled with the later addition of granulation noise to the 
p-mode timeseries, gave rise to asymmetries of the resonant 
peaks in the power frequency spectrum (asymmetries that 
are displayed by the solar p modes). 

To give an idea of the expected quality of the Kepler ob- 
servations, Figure 2 shows how Kepler would see the Sun, 
according to the asteroFLAG simulator, were the Sun to 
be observed continuously for 4 yr at apparent visual mag- 
nitude m v = 9. This is at the bright m v end of the target 
range, which extends down to brightness m v ~ 15 (e.g., 
Christensen-Dalsgaard et al. 2007). 




100 1000 
Frequency (,uHz) 



Fig. 2 How Kepler would see the Sun, according to the aster- 
oFLAG simulator, were it to be observed continuously for 4 yr at 
apparent visual magnitude m v — 9. The power frequency spec- 
trum of the timeseries is rendered in light grey, with the most 
prominent modes observed at frequencies around ~ 3000 /iHz. 
The individual limit contributions of photon shot noise, granula- 
tion, and active-region noise are shown as the dotted lines. The 
total contribution of these three "noise" components is plotted as a 
dark, continuous line. 



2.2 Data for Exercise #1 

For the first phase of Exercise #1, we have prepared time- 
series of Kepler- like data on 3 artificial stars. We have named 
the artificial stars Pancho, Boris and Katrina 1 Here, we present 
results on a total of twenty-eight 4-yr timeseries prepared 
for each star. These timeseries covered all possible combi- 
nations of the following: 

- Four different apparent visual magnitudes, m v = 9, 11, 
13 and 15; 

- Three different angles of stellar inclination, i = 0, 30 
and 60 degrees; 

- Three different mean internal rates of rotation: Sun-like, 
twice Sun-like, and three-times Sun-like; 

1 The chosen names are names of cats with whom several of the authors 
are acquainted. Given the origins of the naming of our stars, it has been 
suggested that our hare-and-hounds exercises should instead be called cat- 
and-mouse exercises. 
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We note that the same realization noise was always used to 
excite the overtones of each (I, m) of a given star, regardless 
of the dataset; however, different realizations of the photon 
shot noise were added at each of the different apparent mag- 
nitudes. As indicated previously, the timeseries did not in- 
clude stellar-cycle-like effects. 

These multiple timeseries were intended to help the hounds 
test their analysis codes, and so the hares also passed to the 
hounds a priori information on the inclinations and rotation 
rates of the datasets. It is in the next phase of Exercise #1 
that data will be released at only one m v per star, on a se- 
lection of new stars, thereby providing true blind tests for 
the hounds. We comment below on the potential impact on 
the results of the additional a priori information given by 
having multiple timeseries on each star. 




7500 7000 6500 6000 5500 5000 4500 4000 
T,« (K) 



Fig. 3 Locations of the stars Pancho, Boris and Katrina (see fig- 
ure annotation) on a temperature-luminosity diagram, with loca- 
tions inferred from the traditional data released on the stars. Here, 
we used the artificial parallax data for m v — 9. The grey lines 
show evolutionary tracks, made with the Padova models (Bonatto, 
Bica & Girardi 2004; Girardi et al. 2002, 2004). 

In addition to the timeseries data, the hares also released 
'traditional' data on the stars, appropriate to each appar- 
ent visual magnitude, m v . The traditional data were: par- 
allaxes, 7T, metallicities, [Fe/H], and effective temperatures, 
T c ff . (Full details on these data will be given in a separate 
paper.) Figure 3 shows the location of the artificial stars 
on a temperature-luminosity diagram. The positions have 
been inferred using the traditional data (with the parallax for 
m v = 9). Here, we followed procedures the hounds would 
need to adopt to convert from absolute visual to absolute 
bolometric magnitude (we used the bolometric corrections 
of Flower 1996). The locations of the stars in Figure 3 in- 
dicate that Pancho is intrinsically the brightest star; whilst 
Katrina is intrinsically the faintest star. 

Figure 4 shows how Kepler would see Pancho (left-hand 
panel), Boris (middle panel) and Katrina (right-hand panel), 
according to the asteroFLAG simulator, were the artificial 
stars to be observed continuously for 4 yr at apparent visual 



magnitude m v = 11. Pancho shows the strongest p-mode 
amplitudes of the three stars, while Katrina has the weakest 
modes. 

3 Results 

The hounds made up six teams: JB, RAG and SJJ-R formed 
one team; while T. Arentoft, OC, STF, CR and DS worked 
individually. The hounds extracted estimates of the large 
frequency spacings using various methods. T. Arentoft used 
a Matched Filter approach, which is similar to methods ap- 
plied in searches for exoplanet transits (see Christensen- 
Dalsgaard et al. 2007). The other hounds used either Fourier 
transforms of the power frequency spectra (one hound actu- 
ally worked on autocorrelation functions of the timeseries) 
or autocorrelations of the power frequency spectra (e.g., see 
Scargle 1989; Ransom, Eikenberry & Middleditch 2002). 
We also note that JB, RAG and SJJ-R worked on "denoised" 
power frequency spectra of timeseries, using the curvelet 
transform (Lambert et al. 2006). For analysis of several time- 
series, some hounds divided the timeseries into shorter pieces. 
Power frequency spectra of these shorter pieces were then 
computed and co-added for subsequent analysis. 

In all cases the hounds had to make choices over what 
ranges in frequency to use for the analyses. Estimates of 
the large spacings are affected to some extent by the range 
that is chosen, because the large spacings are frequency de- 
pendent. The angle of inclination and the magnitudes of the 
mode frequency splittings - both of which affect the appear- 
ance of the mode peaks, both within multiplets, and from 
one degree I to another - will also have a subtle effect on 
the results. The estimates may also be affected by the im- 
plementation of the analysis, for example from the manner 
in which peaks in the autocorrelation, or Fourier transform, 
of the power frequency spectrum are fitted to yield the es- 
timated spacings. Before we show the main results of the 
hounds, we first illustrate the impact of some of the effects 
listed here. 

We computed the smooth, noise-free "limit" power fre- 
quency spectrum of each timeseries, and then analysed each 
noise-free power frequency spectrum to estimate the large 
spacings. When we analysed each spectrum, we used the 
range in frequency that each hound chose when they anal- 
ysed that same spectrum. We estimated the spacings using 
both of the basic methods adopted by the hounds. The re- 
sults that are given correspond to a "best case scenario", in 
that there is no noise in the power frequency spectrum. We 
note that our implementation of the methods most likely dif- 
fered in detail from implementations of the hounds. The re- 
sults provide a guide to differences we might expect from 
the free choice of the frequency range and analysis method, 
and of the inclination and mode frequency splittings. It is 
worth adding that the frequency range selected for analysis 
is information one would aim to use in determining the stel- 
lar radius, even if it was not possible to measure individual 
mode frequencies reliably. 
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Figure 5 shows the estimated spacings extracted from 
noise-free power frequency spectra of the artificial star Boris. 
Each symbol is used to show results for the frequency ranges 
chosen by a particular hound. The left-hand panel shows re- 
sults from using the autocorrelation of the power frequency 
spectrum; while the right-hand panel shows results from us- 
ing the Fourier transform of the power frequency spectrum. 
Agreement between the results is of course very good, so 
much so that it is hard to tell results apart for the auto- 
correlation method. However, there are differences present, 
which are in some cases as large as w 0.75 % of the mean 
spacings. We consider below how scatter in the large spac- 
ing estimates translates to uncertainty in estimates of stellar 
radii. 

The main results on the large frequency spacings Av are 
shown for each star in Figures 6, 7 and 8. The various sym- 
bols show results for different hounds. (JB, RAG and SJJ-R 
concentrated on developing application of the curvelet tech- 
nique, and have returned results initially for Pancho only.) 
A first look at the results showed that there was no clear, 
systematic dependence of the estimated spacings on either 
the inclination or the internal rate of rotation. We therefore 
decided not to differentiate between these parameters when 
plotting the results (so that all estimates of Av for a given 
star are plotted on the same graph). 

It is important to recognise that choices made for the 
higher noise (larger m v ) spectra may have been influenced 
by results on the lower noise (smaller m v ) spectra. Per- 
haps the most important choice is the part of the power fre- 
quency spectrum that is selected for subsequent analysis. 
The choice can be less than straightforward when the mode 
peaks are not readily apparent in the power frequency spec- 
trum. Under such circumstances it may still be possible to 
extract a robust estimate of the spacing provided the right 
part of the spectrum is selected. This is the most obvious 
example of where our hounds will have learned from, and 
therefore benefited by, their selections made for the lower 
noise spectra. 

We should add that information included with the results 
returns (together with the results themselves) suggests that 
the hounds did attempt to treat each timeseries on its own 
merits. But this may not always have been possible where 
the choice of frequency range was concerned. For analysis 
on real stars, and in the absence of prominent mode peaks 
in the power frequency spectrum, one would seek to use 
already-known traditional information on the star to help 
fix suitable ranges in frequency to analyse. Furthermore, 
the curvelets used by JB, RAG and SJJ-R, certainly help 
in cleaning up the raw spectra to reveal the presence of any 
modes. 

Let us now turn to the main results. The top left-hand 
panel of each figure shows estimates of the large spacings 
returned by the hounds. The error bars show the uncertain- 
ties in Av required to give 1 % uncertainties on the inferred 
radii of the stars. These values follow straightforwardly from 



the dependence of the mean spacing on the mean density of 
the star (e.g., Kjeldsen & Bedding 1995): 

Av oc M 1 / 2 /? -3 / 2 , (1) 

so that 

SR/R = -2/3SAv/Av. (2) 

The absolute uncertainty in Av required to give a 1 % un- 
certainty in R is therefore given by: 

6Av 1 % = 0.01 x 3/2Av = 0.015Aza (3) 

The top right-hand panels of each figure again show esti- 
mates of the large spacings, but plotted over a much larger 
range on the ordinate to show poor estimates of the spac- 
ings. 

The bottom left-hand panels of each figure show esti- 
mated spacings extracted (by WJC) from analysis of auto- 
correlations of noise-free power frequency spectra (see Fig- 
ure 5 and discussion above). The different symbols show re- 
sults for the frequency ranges chosen by particular hounds. 
These results serve as a useful "noise-free" reference for 
the main (noisy timeseries) results shown in the top panels 
of each figure. 

Finally, the bottom right-hand panels show estimates of 
the uncertainties on the large spacings returned by the hounds 
The dashed lines show standard deviations of the results 
of the hounds at each apparent visual magnitude, m v . The 
dotted lines again show the uncertainties in Av required to 
give 1 % uncertainties on the inferred stellar radii. The most 
striking aspect of the uncertainty estimates is that they cover 
such a wide range. 

4 Discussion 

How should we interpret the precision in the results (i.e., the 
observed scatter between hounds), and the uncertainty data 
plotted in the bottom right-hand panel of each figure? In 
reaching a conclusion we need to remember that all datasets 
on a given star had the same mode realization noise, but 
different shot noise. 

At the brighter magnitudes (lower noise spectra), scatter 
between hounds is dominated by differences in implemen- 
tation of the analysis (what we might term reduction noise), 
which includes the impact of the different frequency ranges 
chosen by the hounds (see lower left-hand panels of Fig- 
ures 6 to 8). The magnitude of this observed scatter is larger 
than the characteristic internal precision on the estimated 
spacings. By internal precision, we mean the typical pre- 
cision we would expect to get were one of the hounds to 
analyse many datasets having different shot and mode re- 
alization noise. For example, T. Arentoft analyzed several 
fully independent timeseries realizations of Boris (made by 
WJC), and found that the characteristic internal precision 
on the estimated spacings was ~ 0.04 ^Hz at m v = 9, and 
~ 0.20 /iHz at m v = 11. The observed scatter between 
hounds is « 0.5 ^Hz at both magnitudes. At the fainter 
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magnitudes, where scatter between hounds increases, the in- 
fluence of different realizations of the shot noise comes into 
play, and the internal precision also drops. 

The quoted uncertainties should give robust estimates 
of the internal precision. However, it is clear from Figures 6 
to 8 that the quoted values cover a wide range at each m v . 
Some of the hounds' uncertainties were very much smaller 
even that the expected internal precision. In several cases, 
this may have been because those estimates came from stan- 
dard least-squares fits to autocorrelations of the power fre- 
quency spectra, where no account had been taken of the 
strong correlations present in the autocorrelation functions. 
(See also Chaplin et al. 2007b, for discussion of a similar 
problem, using the cross correlation function.) 

5 Conclusion 

The following conclusions may be drawn from the results: 

1 . It is possible to extract robust estimates of the large fre- 
quency spacings, Ais, for many of the timeseries we 
made. Estimated spacings of the different hounds, re- 
turned at values of apparent visual magnitude where ro- 
bust estimation is possible, show agreement at a level 
typically better than 1 %. 

2. The observed level of agreement implies a contribution 
to the uncertainty on inferred stellar radii of typically a 
few tenths of 1 %. 

3. Scatter in the results increases significantly at m v = 15 
for Pancho; at m v > 13 for Boris; and at m v > 9 for 
Katrina. Indeed, for the intrinsically fainter Katrina no 
results on the spacings were returned at m v > 11. 

4. The observed scatter between hounds for the brighter 
stars tends to be larger than the characteristic internal 
precision expected, given the intrinsic quality of the data. 
The main contribution to this additional scatter appears 
to be reduction noise (i.e., differences in implementation 
of the analysis). 

5. Estimation of uncertainties in the large spacings, from 
fits made to prominent peaks in the autocorrelation of 
the power frequency spectrum, must make proper al- 
lowance for the strong correlations that are present in 
the autocorrelation function. 

The next phase of the exercise will involve true blind 
tests on single timeseries of new stars. We then intend to 
use the results, together with further tests on the data here, 
to inform development and refinement by the KASC of the 
analysis pipeline for extracting the frequency spacings. The 
results of the asteroFLAG exercises also need to be under- 
stood in the context of the Kepler simulations undertaken at 
Aarhus (see Christensen-Dalsgaard et al. 2007). 
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Fig. 4 How Kepler would see Pancho (left-hand panel), Boris (middle panel) and Katrina (right-hand panel), according to the aster- 
oFLAG simulator, were the artificial stars to be observed continuously for 4yr at apparent visual magnitude m v = 11. The plots show 
average power frequency spectra, made by dividing the full timeseries into short 4-day segments and co-adding the individual spectra. 
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Fig. 5 Estimated spacings extracted from noise-free power frequency spectra of the artificial star Boris. Each symbol is used to show 
results for the frequency ranges chosen by a particular hound. The left-hand panel shows results from using the autocorrelation of the 
power frequency spectrum; while the right-hand panel shows results from using the Fourier transform of the power frequency spectrum. 
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Fig. 6 Results, on estimation of the large spacings, Av, for artificial timeseries of Pancho. Symbols show results for different hounds. 
Top left-hand panel: estimates of the large spacings returned by the hounds. The error bar shows the uncertainty in Av required to give 
a 1 % uncertainty on the inferred radius of the star. Top right-hand panel: estimates of the large spacings, but plotted over a much larger 
range on the ordinate to show poor estimates of the spacings. Bottom left-hand panel: estimated spacings extracted from noise-free 
power frequency spectra by WJC (see Figure 5), using the autocorrelation of the power frequency spectrum. This is the only panel in 
which symbols do not indicate results for different hounds, but rather the results of WJC for the frequency ranges chosen by different 
hounds. Bottom right-hand panel: estimates of the uncertainties on the large spacings returned by the hounds. The dashed line shows the 
standard deviation of the results of the hounds at each apparent visual magnitude, m v . The dotted line again shows the uncertainty in 
Av required to give a 1 % uncertainty on the inferred radius of the star. 
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Fig. 7 Results, on estimation of the large spacings, for artificial timeseries of Boris. (Details as per Figure 6.) 
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Fig. 8 Results, on estimation of the large spacings, for artificial timeseries of Katrina. (Details as per Figure 6.) 
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